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EVALUATION AT LOYOLA 


Introduction 


Evaluation is a word which is always being used in the 
university milieu. Professors evaluate students by 
assessing their readiness or preparedness for the 
course, monitoring their performance and directing 
their energies, and assigning final grades. Students 
evaluate professors informally in conversations with 
other students and faculty, and formally through 
course evaluation questionnaires. In this newsletter 
we would like to consider course evaluation in more 
detail by looking at some of its history and evolution 
at Loyola, the current situation, and some of the 

most often asked questions. 


History 


Formal course evaluation began in 1969 as a student 
initiative with the prime purpose being to give stu- 
dents specific information that would help them when 
selecting courses. This information was well received 
and used by some sections of the community. In 1972 
the Loyola Senate made it compulsory for one year for 
all professors to administer course questionnaires in 
their courses; that information was then to be consi- 
dered as part of contractual recommendation procedures. 
It was at this time that the Learning Development 
Committee was created to be responsible for course 
evaluation and to provide support and resources for 

the improvement of teaching. By 1974 the Committee's 
work had grown to such an extent that the Learning 
Development Office was created. In 1975 the Loyola 
Faculty of Arts §& Science Council approved a series 

of recommendations from that Committee which made some 
substantial changes in the system and created the 
current procedures and policies. (Note - These 
policies apply only to Arts § Science. ‘Other facul- 
ties have their own procedures.) These can best be 


understood if we separate them into 
three areas: contractual recommen- 
dations on teaching effectiveness, 
teaching improvement, and informa- 
tion for students. 


Contractual recommendations on 
teaching effectiveness 


It is the responsibility of each 
department to develop its own poli- 
cies and procedures for making con- 
tractual recommendations on teach- 
ing effectiveness. It is also their 
responsibility to collect whatever 
information is necessary to support 
those recommendations. The Learn- 
ing Development Committee and 

Office are available to provide 
whatever consultative and technical 
assistance is requested; as well as 
to administer and process any course 
questionnaires that are developed, 
if requested. 


Question - Is course evaluation 

compulsory? 

Only if your department requires 
student questionnaires as a ne- 

cessary part of the departmental 
recommendation procedures. 


Question - I don't receive course 
evaluation packages from the 
Learning Development Office any- 
more. How come? 

We only send packages to professors 
in departments that have requested 
our assistance in the administration 
and processing of the course ques- 
tionnaire they have adopted. 


Question - Course evaluations 
shouldn't be used in contractual 
decisions. They aren't reliable or 
valid. 

There is not enough space in 10 news- 
letters to review all the research 
on student evaluation. Student 
evaluations, if properly done, rep- 
resent one type of input from a very 
important source. 


Student perceptions of teacher per- 
formance and effectiveness can be 
reliably and validly collected by 
course questionnaires. The parti- 


cular weight attached to this one 
source of information can vary among 
departments, but it should not be over- 
looked. 


Question - What other methods, besides 
course evaluation, can be used to collect 
information from students? 


If you are referring to other methods of 
collecting student perceptions, then no 
other method would survey as many students, 
as quickly, and give results which can 

be as easily tabulated. Besides different 
types of questionnaires - using mainly 
open-ended questions - individual or group 
interviews of all or part of a class are 
perhaps the only other ways. 


Question - Isn't there more to the eval- 
uation of teaching effectiveness than 
student perceptions? 


Certainly, but all other methods involve 
more work in the collection and/or analysis 
of the information. .They also depend to 

a large degree on how you see the role of 
teachers and how you define teaching 
effectiveness. If you define good teach- 
ing as good learning, then you might want 
to examine final exams, course grades, or 
pre-test /post-test gains. If you see one 
of the roles of the professor as being a 
course designer - selecting material, 
deciding on goals and objectives, deter- 
mining the teaching method, etc. - then 
you would want a detailed course outline 
to examine. This is where faculty members 
can, if they wish, be involved in the 
assessment of teaching in ways other than 
simply by trying to analyze course eval- 
uation results. 


Improving Teaching Effectiveness 


Evaluation for improvement should be 
different and separate from evaluation 
for contractual purposes. Most course 
questionnaires (for contractual purposes) 
are not specific or detailed enough to 
provide appropriate information to sup- 
port changes in a course. In order to 
assist professors collect information 
upon which to base decisions on changes 
for improvements in their courses, the 
Learning Development Office has estab-. 
lished the Teaching Learning Analysis 
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Service. While we recognize that the 
name is quite awkward, it does describe 
the service accurately. This is not 
an evaluation service in the usual 
sense of that word, but rather an in- 
formation collection service which 
can provide data on teaching and 
learning in your classroom. This 
data can be analyzed to determine 

if changes are needed and what sort 
of changes would be appropriate. 
There are several specific features 
of this service: it is confidential, 
individualized, and available upon 
request. 


Question - How is this different 
from the usual course evaluation? 


You determine the method and pur- 
pose of data collection. Even if you 
choose a questionnaire as the method 
to collect the information you want, 
this questionnaire is one that you 
have designed or selected, and it 
asks the questions that are impor- 
tant for you. The Learning Devel- 
opment Office has a large bank of 
questions and questionnaires avail- 
able from which you can create a ques- 
tionnaire; or you can make up your 
own questions. The results would 
remain confidential. 


Question - What other methods are 
there? 

Some of the other methods include 
interviews, in-class observations, 
videotape, or audio tapes. The par- 
ticular method chosen should be ap- 
propriate to your class, your style, 
and to the kind of information desired. 


Question - Why do I need the Learn- 
ing Development Office for this? 

It is quite possible that you don't. 
We are available, if you wish, to 
assist in designing the method of 
collecting the information, collect- 
ing it, and processing the results. 
This service is available to all 
professors on the Loyola campus, day 
or evening, full or part-time. 


Course Evaluation Guide 


The Learning Development Committee 


recognized that it had been unable 

to satisfactorily publish the results 
of course evaluations in a way that 
would be easy for students to read and 
understand and yet accurately reflect 
the complexity and richness of data. 
The Faculty Council accepted our recom- 
mendation that the Course Evaluation - 
Guide be discontinued and that the 
Course Selection Guide be continued. 


Question - How can students get eval- 
uative information? 

By talking to students who have taken 
the course, or departmental student 
association-representatives, they might 
be able to get some of that information. 
They can make their own assessments 
after their first few classes. However, 
our information indicates that students 
want more detailed information about 

the course - similar to the Course Sel- 
ection Guide - rather than the type 

of evaluative information we had been 
providing. 


Future issues of Teaching and Learning 
will look at other aspects of evalua- 
tion; evaluation to help learning, 
evaluation for accreditation or certi- © 
fication, etc. If you have specific 
questions, specific issues you would 
like to see discussed, or a comment 
about evaluation you would like printed, 
please contact the Learning Development 
Office in the Hackett Building, Room 
491 at Local 397. 


If you are interested in talking about 
teaching with other faculty, perhaps 
you'd like to know more about our 


regularly held "Informal Discussions 
on Teaching". (Loc. 397 for more infor- 
mation.) 


